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We present here an exploration on on the physical implications of the Darwinian dynamics. We 
first show that how the nonequilibrium statistical mechanics emerges naturally. We then show that 
the first three laws of the thermodynamics, the Zeroth Law, the First Law and the Second Law can be 
followed from the Darwinian dynamics, except the Third Law. The inability to derive the Third Law 
indicates that the Darwinian dynamics belongs to the "classical" domain. Specifically, the Second 
Law is proved from the dynamical point of view. Two types of current dynamical equalities are 
explicitly discussed in the paper: one is based on Feynman-Kac formula and one is a generalization 
of the Einstein relation. Both are directly accessible to experimental tests. Our demonstration 
indicates that the Darwinian dynamics is logically a simple and straightforward starting point to 
get into thermodynamics and is complementary to the conservative dynamics dominated in physics. 
; PACS numbers: 

05.70.Ln Nonequilibrium and irreversible thermodynamics 
pH . 05.10.Gg; stochastic analysis methods (Fokker-Planck, Langevin, etc); 

^) ' 02.50.Fz; stochastic processes; 

I ' 87.15.Ya Fluctuations 

One of the principle objects of theoretical research in any department of knowledge is to find the point of view from 
O ' which the subject appears in its greatest simplicity. 
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>v I. INTRODUCTION 

The theory proposed by Darwinian and Wallace^* on the evolution in biology has been the fundamental theoret- 
ical structure to understand biological phenomena for nearly one and half centuries, referred to as the Darwinian 
■ dynamics in the present paper. In its initial formulation, the theory was completely narrative. No single equation 
was used. There have been continuous effects to clarify its meaning and to make it into more quantitative hence 
1^ . more predictive2iiiSiSiL&. Tremendous progresses have made during past 100 years. Now the degree of its usage of 
^v^j ' mathematics is comparable to any other mathematically sophisticated natural science. From the physics point of 
£N) . view, this theory is a bona fide nonequilibrium dynamical theory. 

y—i • In physics there has been a sustained interest during past several decades in nonequilibrium processes2*i2*ii*i2iiiii2iiii. 
The important goals are to bridge its connection to equilibrium processes and to clarify the roles of entropy and 
the Second Law of thermodynamics. Thanks to recent progresses in experimental technologies, particularly the 
r/2 | nanotechnololgy, many previous inaccessible regimes are now been actively explored. There have renewed interests 
in this field, ranging from physicsiSiiLi2iiS, chemistrjiSS, material science^!, biology^, and to many other fields^. 
Quantitative experimental and theoretical studies find their ways into the cellular and molecular processes of life. 
There is a strong going interaction between physical and biological sciences. The purpose of the present paper is to 
look at the fundamental issues in statistical mechanics and thermodynamics from the point of view of the Darwinian 
dynamics and to gain a new insight. 

There is even an active interest from philosophical point of view on the foundation of statistical mechanics and 
thermodynamics. Relevant to the present paper, following three fundamental but controversial problems have been 
formulated-^ : 1) In what sense can thermodynamics said reduced to statistical mechanics? 2) How can one derive 
equations that are not time-reversal invariant from a time-reversal invariant dynamics? 3) How to provide a theoretical 
basis for the " approach to equilibrium" or irreversible processes? 

The Darwinian dynamics can answer all three questions in its own way. For the first question, as long as the 
statistical mechanics is formulated according to the Boltzmann-Gibbs distribution, the main structures of statistical 
mechanics and thermodynamics are equivalent. For the second question, it is found that the thermodynamics is based 
on the energy conservation and on the Carnot heat engine. It deals with quantities at equilibrium or steady state 
without time. There is no direction of time. Hence, there is no conflict between the thermodynamics and the time- 
reversal dynamics. For the last and third question, Darwinian dynamics comes with an adaptive behavior-'— &4Jh7-3 
and with a built-in direction of time. It naturally provides a framework to address the question of "approaching 
to equilibrium". If one would insist, the third question might be transformed into another one: What would be the 
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implication that there is a mutual reduction between the Darwinian dynamics and the Newtonian dynamics^? Answer 
to this last question will not be attempted in the present paper. The base to answer above three questions will be 
discussed in next few sections. 

The rest of the paper is organized as follows. In section II the Darwinian dynamics will be summarized in the 
light of recent progress. In section III it will be shown that the statistical mechanics and canonical ensemble follows 
naturally from the Darwinian dynamics. In section IV the connection to thermodynamics is explored. There it will 
be shown that the Zeroth Law, the First Law, and the Second Law can follow from the Darwinian dynamics, not 
the Third Law. In section V two types of simple but seemly profound dynamical equalities discovered recently, one 
based on the Feynman-Kac formula and one a generalization of the Einstein relation, are discussed. In section VI the 
present demonstration is put into perspective. No mathematical rigor is pursued in the present paper, but the care 
has been taken to make the demonstrations as clear as possible. With the solid physical and biological foundations 
behind, a rigorous mathematical formulation is possible. 

II. DARWINIAN DYNAMICS, ADAPTIVE LANDSCAPE, AND F-THEOREM 

This section summarizes the recent results on the Darwinian dynamics. 

A. Stochastic differential equation: the trajectory view 

In the context of genetics the Darwin's theory of evolution^ may be summarized verbally as that the evolution is 
a result of genetic variation and its ordering through elimination and selection. Both randomness and selection are 
equally important in this dynamical process. With an suitable time scale, the Darwinian dynamics may be represented 
by the following stochastic differential equation^ 

q = f(q)+JVi(q)e(t), (1) 

where f and q are rt-dimcnsional vectors and f a nonlinear function of q. The genetic frequency of i-th trait is 
represented by qi. Nevertheless, in the present paper it will be treated as a generic real function of time t. All 
quantities in this paper are dimensionless. They are assumed to be measured in their own proper units unless 
explicitly specified. The collection of all q forms a real n-dimensional phase space. The noise £ is a standard Gaussian 
white noise with I independent components: (£2)5 = , and 

(&(t)&(0>* = *M(f-i') > (2) 

and i,j = 1, 2, I. Here (...)$ denotes the average over the noise variable {£,(t)}, to be distinguished from the average 
over the distribution in phage space below. The positive numerical constant 9 describes the strength of noise. 

A further description of the noise term in Eq.JQ) is through the n x n diffusion matrix -D(q), which is defined by 
the following matrix equation 

tf/(q)JVT(q)=2D(q), (3) 

where Nj is annxl matrix, NJ is its the transpose, which describes how the system is coupled to the noisy source. 
This is the first type of the F-theorem£, a generalization of Fisher's fundamental theorem of natural selection^ in 
population genetics. According to Eq.(2) the n x n diffusion matrix D is both symmetric and nonnegative. For the 
dynamics of state vector q, all what needed from the noisy term in Eq.(l) are the diffusion matrix D and the positive 
numerical parameter 8. Hence, it is not necessary to require the dimension of the stochastic vector £ be the same as 
that of the state vector q. This implies that in general I ^ n. 

It is known that a large class of nonequilibrium processes can be described by such a stochastic differential 
equation2*ifl*ii*iSiiiiiii^. There is a strong current interest on such stochastic and probability description ranging 
from physicsi2ii£, chemistryjSS,, material science^, biology^, and other fieldsS. 

The Darwinian dynamics was conceived graphically by Wright in 1932 as the motion of the system in an adaptive 
landscap e) 4 ! 6 ! 7 . Since then such a landscape has been known as the fitness landscape in some part of literature. 
However, there are a considerable amount of confusion on the definitions of fitness^. In this paper a more neutral 
term, the (Wright evolutionary) potential function, will be used to denote this landscape. The adaptive landscape 
connecting both the individual dynamics and its final destination is intuitively appealing. Nevertheless, it had been 
difficult to prove its existence in a general setting. The difficulty lies in the fact fact that typically the detailed 
balance condition does not hold in Darwinian dynamics, that is, £) _1 (q)f(q) cannot be written as a gradient of scalar 
function 9 ! 11 ! 12 !",^. 
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Figure 1. Adaptive landscape with in potential contour representation. +: local basin; — : local peak; x: pass 
(saddle point). 

During the study of the robustness of the genetic switch in a living organism^ a constructive method was discovered 
to overcome this difficulty: Eq.(l) can be transformed into the following form of stochastic differential equation, 

[R(q) + T(q)]q = -V0(q; A) + jV//(q)£(i) , (4) 

where the noise £ is from the same source as that in Eq.(l). The parameter A denotes the influence of non-dynamical 
and external quantities. It should be pointed out that the potential function <j) may also implicitly depends on 9. The 
friction matrix R(q) is defined through the following matrix equation 

NuiqjNhiq) = 2R(q) , (5) 

which guarantees that R is both symmetric and nonnegative. This is the second type of the F-theorerrA The 
F-theorem emphasizes the connection between the adaption and variation and is a reformulation of fluctuation- 
dissipation theorem in physics^*2&. For simplicity we will assume det(i?) ^ in the rest of the paper. Hence 
det(i? + T) ^ 27 . The breakdown of detailed balance condition or the time reversal symmetry is represented by the 
flniteness of the transverse matrix, T ^ 0. The usefulness of the formulation of Eq.Q) is already manifested in the 
successful solution of outstanding stable puzzle in gene regulatory dynamics^ and in a consistent formulation of the 
Darwinian dynamics^. 

The n x n symmetric non-negative friction matrix R and the transverse matrix T are related to the diffusion matrix 

D: 

R(q) + T(q) 



D(q) + A(q) ' 

Here A is an antisymmetric matrix determined by both the diffusion matrix D(q) and the deterministic force f (q) 27 ' 28 . 
One of more suggestive forms of above equation is 

[R(q) + T(q)]D[R(q) - T(q)] = R(q) . (6) 

This symmetric matrix equation implies n(n+l)/2 single equations from each of its element. The Wright evolutionary 
potential function </>(q) is connected to the deterministic force f(q) by 

-V0(q;A) = [i?(q)+T(q)]f(q). 

Or its equivalent form, 

Vxp(q)+r(q)]f(q)]=0, (7) 

Here the operation Vx on an arbitrary n-dimensional vector v is a matrix generalization of the curl operation in 
lower dimensions (n = 2,3): (V x v).y = V^Wj — VjVi . Above matrix equation is hence antisymmetric and gives 
n(n— l)/2 single equations from each of its element. From Eq.@ and J2J the friction matrix R, the transverse matrix 
T, and the potential function (j) can be constructed in terms of the diffusion matrix D and the deterministic force 
f . The local construction was demonstrated in detail in Refi2£. For a global construction an iterative method was 
outlined in RefiSS . 

In the case the stochastic drive may be ignored, that is, 9 — 0, the relationship between Eq.(l) and (@J remains 
unchanged. Furthermore, Eq.Q) becomes a deterministic equation 

[R(q) + T(q)]q = -V0(q; A) . (8) 

Because of the non-negativeness of the friction matrix, one obtains 

^(q;A) = q-V^(q;A) 

= -cf[i?(q) + T(q)]q 

= -q r i?(q)q 

< . (9) 



4 



It is immediately clear that the Wright evolutionary potential function 0(q; A) is a Lyapunov function and the 
deterministic dynamics makes it non-increasing: the tendency to approach the nearby potential minimum to achieve 
the maximum probability. This is precisely what conceived by Wright. The adaptive dynamics has been actively 
exploring in biologyi 

The conservative Newtonian dynamics may be regarded as a further limit of zero friction matrix, R = 0. Hence, 
from Eq.(JH|, the Newtonian dynamics may be expressed as, 

T(q)q=-V<Kq;A). (10) 

Here the value of potential function is evidently conserved during the dynamics: q • V0(q; A) = 0, that is, the system 
moves along the equal potential contour in the adaptive landscape. 



B. Fokker-Planck equation: the ensemble view 

It was heuristically argued^ that the steady state distribution p(q) in the state space is, if exists, 

p(q, t = oo) oc e -Wi' A ) . (11) 

Here (3 — 1/9. It takes the form of Boltzmann-Gibbs distribution function. Therefore, the potential function <j) 
acquires both the dynamical meaning through Eq.QJ and the steady state meaning through Eq. l|ll|) . 

It was further demonstrated that such a heuristical argument can be translated into an explicit procedure such 
that there is an explicit Fokker-Planck equation whose steady state solution is indeed given by Ea. (|ll|! 29 . Starting 
for the the generalized Klein-Kramers equation, taking the limiting procedure of the zero mass limit, the desired 
Fokker-Planck equation corresponding to Eq. is 

= V T [£>(q) + A(q)} [9V + V0(q; A)]p(q, t) . (12) 

This equation is also a statement of conservation of probability. It can be rewritten as the probability continuity 
equation: 

^+V.J(q,*)-0, (13) 

with the probability current density j 

j(q,t) e - p(q) + i(q)][^V + V^(q; A)]p(q,i) . (14) 

The reduction of dynamical variables has often been done by the well-known Smoluchowski limit. In the above 
derivation we take the mass to be zero, keeping other parameters, including the friction and transverse matrices, 
to be finite. Nevertheless, in the Smoluchowski limit it is the friction matrix to be taken as infinite, keep all other 
parameters to be finite. Those two limits are in general not exchangeable. 

The steady state configuration solution of Eq. I|12|) is indeed given by Eq. (jllfl . It would be interested to point out 
that the steady state distribution function, Ea. (|ll|) . is independent of both friction matrix R and the transverse matrix 
T. Furthermore, we emphasize that no detailed balance condition is assumed in reaching this result. In addition, 
both the additive and multiplicative noises are treated here on equal footing. 

Finally, it can be verified that above construction leading to Ea. (|12f> is valid and remains unchanged when there is 
an explicit time dependent in R, T, and/or <f>. In this case though there may not exist a steady state distribution if 
the Wright evolutionary potential function (j) is time dependent. 



III. STATISTICAL MECHANICS 



A. Central Relations in Statistical Mechanics 



As discussed above, if treating the parameter 6 as temperature, the steady state distribution function in phase space 
is indeed the familiar Boltzmann-Gibbs distribution, Ea. lll|l . The partition function, or the normalization constant, 
is then 

Z e (\) = [ dne'f 3 ^ . (15) 
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The integral J dq denotes the summation over whole phase space. The normalized steady state distribution is 

e -/30(q;A) 

peid) ee . (16) 

Ze 

For a given observable quantity O(q), its average or expectation value is 

<0) q EE J dqO(q)p e (q) 



1 

2^ 



dqO(q)e- W « ;A) . (17) 



The subscript g denoted that the average is over phage space, not over the noise in Eq.QJ or Ea. i|17[l is the 
summit of statistical mechanics. 



B. Stochastic process and canonical ensemble 

A main question is that for a given Fokker-Planck equation, can the corresponding stochastic differential equation 
in the form of Eq. Q be recovered? The answer is affirmative and the procedure to carry it out is already contained 
in Eq. l|12[l . which will be briefly demonstrated below. 

A generic form for the Fokker-Planck equation may be expressed as follows: 

= V T [£D(q)V - f (q)]p(q, t) . (18) 

Here D(q) is the diffusion matrix and f(q) the drift force. The main motivation to take such a form is simple: In the 
case detailed balance condition is satisfied, i.e., A(q) = (and T(q) = 0), the potential function 4> can be directly 

read from above equation: V0 = D f . It puts the diffusion effect in a very prominent position. Any other form of 
Fokker-Planck equations can be easily transformed into above form. This generic form of the Fokker-Planck equation 
is less tangible to additional complications such as the noise induced first order transitions caused by the q-dependent 
diffusion constant. 

A potential function 4>{q) can always be defined from the steady state distribution. There is an extensive mathe- 
matical literature addressing this problem^. After this is done, though it can be a difficult mathematical problem, 
the procedure to relate the genetic Fokker-Planck equation to Eq. l|12fl is particularly straightforward. Ea. l|12() can be 
rewritten as 

^^=\7 T [eD(q)\7 + e(V T A(q))-[D( q )+A(q)]V4>(q)}p(q,t) . (19) 

The antisymmetric property of the matrix A(q) has been used in reaching Ea. (|19|) . Thus, comparing between Ea. lll8|l 
and l|19fl . we have 

£>(q) = D(q) , (20) 

0(q) = 0(q) , (21) 
f (q) = f (q) + fiVM(q) . (22) 

In reaching Ea. (|22(l we have used the relation 

-[D(q) + A(q)]V#q)=f(q) . 

The explicit equation for the anti-symmetric matrix A is 

9\7 T A(q) + [D(q) + A(q)]V0(q; A) - f (q) , (23) 

which is a first order linear inhomogeneous partial differential equation. The solution for A can be formally written 
down 



A{q) = ~ y q dq'[f(q') - D(q')V (^(q' ; X)}e^^'^' ^ + A (q)e^ q; 



A) 



(24) 
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Here ^4o(q) is a solution of the homogenous equation #V T A(q) = and the two parallel vectors in the integrand, such 
as dq' f(q), forms a matrix. This completes our answer to the converse question. 

It is interesting to note that the shift between the zero's of the potential gradient and the drift is given by, from 

Af = 6>V r A(q) , (25) 

that is, the extremals of the steady state distribution are not necessary determined by the zero's of drift. This is the 
formula for such a shift shown extensively in numerical studies^. This shift can occur even when D = constant. 

Thus, the zero-mass limit approach to the stochastic differential equation is consistent in itself. The meaning of the 
potential (j> is explicitly manifested in both local trajectory according to Eq.Q and ensemble distribution according to 
Eci. (|12J) . In particular, no detailed balance condition is assumed. There is no need to differentiate between the additive 
and multiplicative noises. This zero mass limit procedure which leads to Eq.Q from Ea. (|12J) may be regarded as 
another prescription for the stochastic integration, in addition to those of Ito and Stratonovichii*i2ii^. The connection 
to those methods of treating stochastic differential equation is suggested through Eas. (|18() and i|I2|) (or Ea. H19|) ). 
The Ito's method puts an emphasis on the martingale property of stochastic processes, which may be viewed as a 
prescription from mathematics. The Stronotovich method stresses the differentiability such that the usual differential 
chain-rule can be formally applied, which may be viewed as the prescription from engineering. The present approach 
emphasizes the role played by the potential function in both trajectory and ensemble descriptions. It may be regarded 
as the prescription from natural sciences. 

We may conclude that the stochastic process, regardless of Ito, Stratonovich, the present method, or others, leads 
to the canonical ensemble with a temperature and a Boltzmann-Gibbs type distribution function. 

C. Discrete stochastic dynamics 

There is another kind of modelling predominant in population genetics and other fields which is discrete in phage 
space and/or time. Here we would not get into it in any detail, except quoting results when necessary. The reasons 
of being able to do so are: 1) It is known mathematically any discrete model can be represented by a continuous one 
exactly, though sometimes such a process may turn a finite dimension problem into an infinite dimension one; 2) By a 
coarse graining average the discrete dynamics in population genetics can often be simplified to continuous ones such 
as diffusion equations or Fokker-Planck equations^ii^. It is generally acknowledged in population genetics and in 
other fields that the diffusion approximation is a good start and usually accurate. 

For the steady state distribution, all one needs to know is the Wright evolutionary potential function </> and the 
positive numerical constant 9 which in many cases can be set to be unity: 9 = 1. Hence, discrete or continuous 
representation is not a physically or biologically relevant point. 

IV. THERMODYNAMICS 

Given the Boltzmann-Gibbs distribution, the partition function can be evaluated according to Eq. l|15|l . Hence, at 
the steady state, all observable quantities are in principle known according to Ea. i|17|) . One may wonder then what 
would be the value of thermodynamics. First, there is a practical reason. In many cases the calculation of the partition 
function is a hard problem, if possible. It would be desirable if there are alternatives. Thermodynamics gives us a 
set of useful relations between observable quantities based on general properties of the system such as symmetries. 
Useful and precise information on one phenomenon can be inferred from the information on other quantities. Second, 
there is a theoretical reason. The thermodynamics has a scope far more general than most other fields in physics. It 
is the only field in classical physics whose foundation and structure not only have survived quantum mechanics and 
relativity shakeups, but become stronger. Furthermore, thermodynamics has a formal elegance which is exceedingly 
satisfying aesthetically. Its influence is far beyond physical sciences. 

There exists already numerous excellent books exposing the thermodynamics from statistical mechanics point of 
view. A thorough treatment can be found in Calient*. A reader-friendly treatment can be found in Ma 3 -. Concise 
and elementary treatments from thermodynamics point of view were given by Pippard 3 ^ and by Reiss^I. In the 
light of those superb expositions, the present discussion may appear incomplete as well as arbitrary. For a systematic 
discussion on thermodynamics the reader is sincerely encouraged to consult those books and/or any of her/his favorites 
not listed here. The main objective here is to show that the Darwinian dynamics indeed implies the main structure of 
thermodynamics, though at a first glance it seems to have no connection. The Darwinian dynamics is at the extreme 
end of nonequilibrium processes. 
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Even given a limited scope of presentation there are already excellent and recent papers. The paper by Oono 
and PanconiS is such an example. It gave a comprehensive review on the problems from the point of view steady 
state thermodynamics. There are overlaps at various places. Nevertheless, there is one main difference: The role of 
"temperature" is emphasized here, instead. The paper by Sekimoto^S gave a detailed discussion on the connection 
between thermodynamics and Langevin dynamics. The main difference is that in the present paper the detailed 
balance condition is not needed. 



A. Zeroth Law 



From the Darwinian dynamics, the steady state distribution is given by a Boltzmann-Gibbs type distribution, 
Eq. (|f determined by the Wright evolutionary potential function <ft of the system and a positive parameter 9 of 
the noise strength. Hence, the analogy of the Zeroth Law of thermodynamics is implied by the Darwinian dynamics: 
There exists a temperature-like quantity, represented by the positive parameter 9. This "temperature" 9 is absolute 
in that it does not depend on the system's material details. 



B. First Law 



From the partition function Zg, we may define a quantity 

F = -9\nZg . (26) 
We may also define the average Wright evolutionary potential function, 

U e = J dq0(q;A)p 9 (q). (27) 

From the distribution function we may further define a positive quantity 

Sg = - J dqpg (q) In pg (q) . (28) 

It is then straightforward to verify that 

Fg = Ug - 9 Sg , (29) 

precisely the fundamental relation in thermodynamics satisfied by free energy, internal energy, and entropy. Hence 
we have the free energy Fg, the internal energy Ug, and the entropy Sg. The subscript 9 emphasizes the steady state 
nature of those quantities. Due to the finite strength of stochasticity, that is, 9 > 0, not all Ug is readily usable: Fg 
is always smaller than Ug. A part of 9 Sg called "heat" cannot be utilized. 

It can also be verified from definitions that if the system consists of several non-interacting parts, Fg, Ug, and Sg 
are sum of those corresponding parts. Hence, they are extensive quantities. No attention is paid here to the fine 
difference between additive and extensive properties. Instead, the "temperature" 9 is an intensive quantity: it must 
be the same for all those parts because they are contacting the same noisy source. Therefore, we conclude that the 
analogy of the First Law of thermodynamics is implied in the Darwinian dynamics. 

The fundamental relation for the free energy, Ea. (|29|l . as well as the internal energy, Ea. l|27|l . may be expressed in 
their differential forms. Considering an infinitesimal process which causes changes in both the Wright evolutionary 
potential function via parameter A and in the steady state distribution function, the change in the internal energy 
according to Eq. l(77|) is 

dUg = J dq dX pg(q) + J dq 0(q; A) dp g (q) 

= pdX + 9dSg . (30) 

This is the differential form for the internal energy. Here the steady state entropy definition of Eq. (|28J) has been used, 
along with J dq dpg(q) — 0, and 

= ~8X a (31) 
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Eg. (|30|l can be written in the usual form in thermodynamics: 

dU e =dW + dQ . 

The part corresponding to the change in entropy is the "heat" exchange: dQ = 9 dS and the part corresponding to 
the change in the Wright evolutionary potential function is the "work" dW = /i dX. The conservation of "energy" is 
most clearly represented by Ea. (|30|) . For the free energy, 

dF e = dUg -d6 S e - OdSg 

= fxdX- S e d6 . (32) 

Ea. (|30J) and (|32J) may be useful in some applications. For example, the "temperature" can be found via Ea. (|30(l : 



dU e 
dS e 



(33) 



This relation may be used to find the "temperature" in a noncquilibrium process if it is not obvious to identify a 
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prior" . 



The convexity of a thermodynamical quantity is naturally incorporated by the Boltzmann-Gibbs distribution. There 
is no restriction on the size of the system. Even for a finite system, phase transitions can occur, because singular 
behaviors can be built into the potential function, and controlled by external quantities. 



C. Second Law 



First, we remind the reader of a few more important definitions. 
A reversible process is such a process that all the relation between quantities and parameters in question is defined 
through the Boltzmann-Gibbs distribution, Eq. Hll[) . From the Darwinian dynamics point of view, the reversible 
process in reality is necessarily a slow or quasi-static process in order to ensure the relevancy of steady state distribution 
for its any practical realization. 

An isothermal process is a reversible process in which "temperature" 9 remains unchanged, 9 — constant. No confusion 
with the thermostated processes, which are in general noncquilibrium dynamical processes, should arises. 
An adiabatic process is a reversible process in which the coupling between the system and the noise source is switched 
off and the system vary in such a way the distribution function remains unchanged along the dynamics trajectory 
when following each point in phase space. This implies that the entropy remains unchanged, Sg = constant. The 
adiabatic process has often been used in irreversible processes in that there is no heat exchange between the system 
and the noisy environment, hence S(t) = constant (c.f. Eg . (|I2*|) ) . 

Now we discuss the analogy of Carnot cycle on which the Carnot heat engine is based. The Carnot cycle consists 
of four reversible processes: two isothermal processes and two adiabatic processes (Fig. l.a,b). The efficiency v of the 
Carnot heat engine is defined as the ratio of the total net work performed over the heat absorbed at high temperature: 

v = -*hT' (34) 



(a) (b) 

Figure 2. Carnot cycle, (a). The /i — A representation, (b). The 9 — S representation. In this temperature-entropy 
representation, the Carnot cylce is a rectangular. 

The total net work done by the system is represented by the shaded area enclosed by the cycle. For the heat 
absorbed at the high isothermal process 1^2, 

AQi 2 = 6 h ighASe,i2 • (35) 
For the adiabatic process 2 — > 3, an external constraint represented by A is released (or applied), 

A5 fl ,23 = , AQ 23 = . (36) 
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For the heat absorbed (rather, released) at the low isothermal process 3^4, 

AQ34 = 8i ow ASg i3i = — AQ43 . (37) 
For the adiabatic process 4 — ► 1, an external constraint is applied (released), 

AS eA i = , AQ41 = . (38) 
Using the First Law, Ea. l|29[l and the fact that the free energy is a state function 

AFtotal = AQ total — AWtotal 

= . (39) 

The minus sign in front of the total work represents that it is the work done by the system, not to the system. The 
total heat absorbed by the system is 

AQ tota i = AQ 12 + AQ34 = AQ 12 - AQ43 = AWtotai ■ 

We further have 

AS e , 12 = AS M3 • (40) 
From Eq.( ), ( ) and ( ) the Carnot heat engine efficiency is then 

, AQ 43 



AQ 



12 



= l-^L, (41) 

Vhigh 

precisely the form in thermodynamics. The beauty of Carnot heat engine is that its efficiency is completely independent 
of any material details. It brings out the most fundamental property of thermodynamics and is a direct consequence 
of the Boltzmann-Gibbs distribution function and the First Law. It reveals a property of Nature which may not be 
contained in a conservative dynamics, at least it is still not obviously to many people from the Newtonian dynamics 
point after more than 150 years of intensive studies. The Second Law of thermodynamics may be stated as that for 
all heat engines operating between two temperatures, Carnot heat engine is the most efficient. The Second Law is 
implied in the Darwinian dynamics. 

There are many other versions of the Second Law, on which the reader is suggested to consult the books listed at 
the beginning of this section. Here we mentioned two equivalent versions from the stability point of view, which frame 
following discussions. 

Minimum free energy statement: For given the potential function and the temperature, the free energy achieves its 
lowest possible value if the distribution is the Boltzmann-Gibbs distribution. 

Maximum entropy statement: For given potential function and its average, the entropy attains its maximum value 
when the distribution is the Boltzmann-Gibbs distribution. This version of the Second Law is the most influential. 
Its inverse statement, the so-called maximum entropy principle, has been extensively employed in the probability 
inference^ both within and beyond physical and biological sciences. 

It is attempting to generalize the entropy definition to the arbitrary time dependent distribution in analogy to 
Eq.lgSJl: 

S(t) = -fdqp(q,t)lnp(q,t). (42) 

There are two apparent drawbacks for such definition, however. First, even if the evolution of the distribution function 
p(q, t) is governed by the Fokker-Planck equation, Eci. (|12[) . in general the sign of its time derivative, dS(t)/dt = S(t), 
cannot be determined, whether or not it is close to the steady state distribution. Though S(t) might indeed be 
divided into an always positive part and the rest, such a partition is arbitrary. More seriously, in general S(t) can be 
either larger or smaller than Sg, which makes such a definition lose its appealing in the view of the maximum entropy 
statement of the Second Law. We will return to S(t) later. 

Nevertheless, if taking the lesson from the potential function that only the relative value is important, we may 
introduce a reference point in the functional space into a general entropy definition. One definition for the referenced 
entropy is2^ 

S r (t) = - [ dq p(q, t) In ^4 + S « ■ ( 43 ) 
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With the aid of inequality ln(l + x) < x and the normalization condition J dq p(q, t) — J dq pe(q) — 1, it can be 
immediately verified that 

5,(0 = / dq p(q, t) In ( 1 + P9(q) .,:^ (q ' f) > | + So 

< 



y (pe(q) - p(q)>*) + s e , 



< Se. (44) 

The equality holds when p(q, t) = pe(q). This inequality is independent of the details of the dynamics and is evidently 
a maximum entropy statement. Furthermore, with the aid of the Fokker-Planck equation, Eg. l|12|) . the time derivative 
of this referenced entropy, dS r {t)/dt = S r (t) is always non-negative: 

dp, .s , p(q,t) 



S r (t) = - J dq^(q,t) In 



»(q) 

p(q,*) 



dq (V T [C(q)+A(q)][0V + V0(q;A)]p(q,t)) In 



pe(q) 



dq (Vln^4) [£>(q)+A(q)][0V + V0(q;A)]^(q,t) 



>(q) 

= J dq j^—^ ([0V + V0(q; A)]p(q, i)f [£>(q) + A(q)][0V + V0(q; A)]p(q, t) 

d * ~a~7~~f\ ^ V + V <^ X M<h t)Y D(q) [0V + V0(q; A)]p(q, t) 
0p(q, i) 

> . (45) 

Hence, this referenced entropy S r (t) has all the desired properties for the maximum entropy statement. 

We remark that by the probability current density definition of Ea. l|14|) j is zero at the steady state. This may 
differ from the usual probability current density definition which may be based on Ea. H18|) and takes the form 
j(q, t) = ~[6DW — f(q)]p(q, i), which is not zero at the steady state. Instead, V • j = at the steady state. 

Though the general definition of entropy of Ea. (|42l) may not be appealing, a general definition of free energy is 
consistent with the Second Law. We demonstrate it here. First, a general definition for the internal energy may be: 

U(t) = J dq^X) p(q,t) . (46) 

Given the distribution and the potential function, quantities defined in Ea. (|42|l and (|46|l can be evaluated. Following 
the form of Ea. (|26|) a general definition of free energy would be, with the "temperature" 8, 

F(t) = U(t) - 9 S(t) . (47) 

It can be verified that F(t) > Fg and its time derivative is always non-positive, F(t) < 0. So defined time dependent 
free energy indeed satisfies the minimum free energy statement of the Second Law. It differs from the referenced 
entropy S r (t) by a minus sign and by a constant: 

F(t) = -6S r (t) + Ug . 

The generalized entropy S(t) has one desired property regarding to the adiabatic processes (either reversible or 
irreversible) in that D = during the adiabatic process. Hence, 



S(t) = - J dq^(q,*) lnp(q,t) 



dq A(q) V0(qjA)p(q,t)] lnp(q,i) 

</=>(q,t) 



- J dq [(A(q) V0(q; A)) • V] J" ' dp' hip' 
. (48) 
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This is the known result in conservative Newtonian dynamics that the entropy remains unchanged. In deriving 
above equation we have used two properties: 1) the no-coupling to the noisy environment has been translated into 
the fact that the terms associated with the diffusion matrix D and "temperature" 9 are set to be zero in Ea. (|12fl . 
because they are related to the noisy source whose information is not available during an adiabatic process; and 2) 
the incompressible condition of V • [A(q) V</>(q; A)] = 0, which is typically satisfied in the Newtonian dynamics. In 
this conservative case, it can be verified that S r (t) = 0, too, for any adiabatic process. 

It may be worthwhile to mention another referenced entropy S r 2(t) which approaches the steady state entropy Sg 
from above. It's form is simple: 

S r2 (t) = -J dqp e {q) lnp(q,f) . (49) 
It can be verified that S r 2(t) > Sg and S r 2(t) < 0. 



D. Third Law 



Now we consider the behavior near zero "temperature", 6^0. To be specific we assume the system is dominated 
by a stable fixed point. As suggested by the Boltzmann-Gibbs distribution, Ea. (|llf> . only the regime of phase space 
near this stable fixed point will be important. Hence the Wright evolutionary potential function can be expanded 
around this point, taking as q = 0: 



n 

(q;A) = #0;A) + -£>(A)g 



(50) 



Here we have also assumed that the number of independent modes is the same as the dimension of the phase space, 
though it may not necessary be so. This assumption will not affect our conclusion below. Those independent modes 
are represented by qj without loss of generality. The "spring coefficients" {kj} are functions of external parameters 
represented by A. 

The partition function according to Eci. (|15fl can be readily evaluated in this situation: 



-/30(O;A) 



n 



So is the entropy according according to Eq.JSSJ): 



Sg 



hx6 



I2n6 



1 n 

IE 



2j_ 

2tt 



(51) 



(52) 



The first term does not depend on external parameters, but the second term does. This suggests that the entropy 
depends on control process in a finite manner at low enough temperature. Hence, the Darwinian dynamics does not 
imply the Third Law in which it states that in the limit of zero temperature the difference in entropy between different 
processes is zero. 

One should not be surprised by above conclusion, because the Darwinian dynamics is essentially a classically 
dynamics. Same a conclusion could also be reached from classical physics. With quantum mechanics, the agreement 
to the Third Law is found and a stronger conclusion has been reached: Not only the difference in entropy should be 
zero, the entropy itself is zero at zero temperature. 

We may conclude that a complete neglecting noise is not viable choice in general. When noise is small enough, new 
phenomena would happen. Phrasing differently, there appears to exist a bottom near which there is something. 

To summarize, in this section we have shown that except the Third Law, all other Laws of thermodynamics would 
follow from Darwinian dynamics. The concern^ on which stochastic integration method, Ito, Stratonovitch, or others, 
is consistent with the Second Law is dissolved: Any of them can be made to be consistent with the Second Law. We 
also note that based on the thermodynamical relations, the fundamental relation of Ea. (|29|l . the conservation of energy 
of Ea. lj3U|) . the universal heat engine efficiency of Ea. ljlT)l . supplemented by the additive of extensive quantities and 
the temperature of Ea. (|33|) . the Boltzmann-Gibbs distribution is implied. In this sense the statistical mechanics and 
the thermodynamics are equivalent. 

Thermodynamics deals with the steady state properties. The key property is determined by the Boltzmann-Gibbs 
distribution of Eq. l|ll|) which only depends on the Wright evolutionary potential function (f> and the "temperature" 
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9. The rest relations are determined by the various symmetries of the system. No dynamical information can be 
inferred from them. In particular, there is no way to recover the information on two quantities determine the local 
time scales, the friction matrix R and the transverse matrix T, from thermodynamics. In this sense the time is lost in 
thermodynamics. With this consideration, it is evident that thermodynamics contains no direction of time and hence 
is consistent with the time-reversal conservative Newtonian dynamics. 



V. DYNAMICAL EQUALITIES 



We have explored the steady state consequences of the Darwinian dynamics in statistical mechanics and in ther- 
modynamics. In this section we explore its general dynamical consequences. Two types of recently found dynamical 
equalities will be discussed: one based on the Feynman-Kac formula and other a generalization of the Einstein relation. 



A. Feynman-Kac formula 

Previous discussions demonstrate that the Boltzmann-Gibbs distribution plays a dominant role. It is naturally to 
work in a representation in which Boltzmann-Gibbs distribution appears in a most straightforward manner, or, as 
close as possible. The standard approach in this spirit is as follows. First, choose the dominant part of evolution 
operator L. The remaining part is denoted as SL. In this subsection a general methodology to carry out this procedure 
is summarized. 

The Fokker- Planck equation, Ea. (|12fl . can be rewritten as 

^p(q,t) = L(V,q;A)p(q,t), (53) 

with L = V T [Z?(q) + v4(q)][6>V + V(j>(q)]. It's solution can be expressed in various ways. The most suggestive form in 
the present context is that given by Feynman's path integral^: If at time t' the system is at q', the probability for 
system at time t and at q is given by summation of all trajectories allowed by Eq.Q connection those two points: 

n(q,t;q',t')= ]T j q(t) = q; q(t') = q' \ . (54) 

trajectories I J 

In terms of the summation over the trajectories, the solution to Eg. (|53|) (and Eq.JT^J) may be expressed as 

p(q,t) = J dq\(q,t;q',t')p(q,t = Q) 

= (5(q(t)-q))\ trajectory . (55) 

The delta function S(q(t) — q) is used to explicitly specify the end point. There is a summation over initial points q' 
weighted by the initial distribution function p(q',t = 0). 

Now, considering that the system is perturbed by <5L(q;A), represented, for example, by a change in control 
parameter A. The new evolution equation is 

d 

^rPnew(q,t) = i(V,q;A) +SL(q;X) ]p new (q,t) . (56) 
at 

The perturbation may act as a source or sink for the probability distribution. The probability is no longer conserved: 
in general J dq p ne w(q,t) ^ f dq p n ew(q,t = 0). According to the Feynman-Kac formula™, its solution to this new 
equation can be expressed as 



p„e»(q,t) =(s(q(t)- q) e J>' 



(57) 

trajectory 

with pnew(q\ t = 0) = p{q', t = 0) and the trajectories following the dynamics of Eq.QJ, the same as that in Ea. (|55|l . 
Thus, the evolution of the new density can be expressed by the evolution of the original dynamics. The corresponding 
procedure in quantum mechanics is that in the interaction pictured. Eq. <|57|l is a powerful equality. Various dynamical 
equalities can be obtained starting from Ea. l|57|) . Indeed, its direct and indirect consequences have been extensively 
cxplored^iii. 
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B. Dynamical work and free energy difference 



We have noticed the special role played by the Botlzmann-Gibbs distribution, Ea. l|ll|l . In particular, it is indepen- 
dent of the friction and transverse matrices R, T. Evidently the instantaneous Botlzmann-Gibbs distribution with 
A = A(i) is 

e -/30(q;A(t)) 

p ^ m) -^mv (58) 

Here we have explicitly indicated that the parameter is time-dependent. This distribution function is no longer the 
solution of the Fokker-Planck equation of Eg . I|12l) . There will be transitions out of this instantaneous Boltzmann- 
Gibbs distribution function due to the time-dependence of the parameter A. While such transitions may be hard to 
conceive in classical mechanics, they can be easily identified in quantum mechanics, because of discreteness of states^. 
One of such well studied models is the dissipative Landau-Zener transition^. 

The interesting question is that whether the transitions can be reversed such that the instantaneous distribution is 
indeed an explicit solution for another but closely related evolution equation. This means that the original Fokker- 
Planck equation has to be modified in a special way to become a new equation. Indeed, this modified evolution 
equation can be found for any function p(q, t), which reads, 



— 

Pnew (Q; £J 



i(V )q)i )-^-(i(V iq ,t)p(q,t)) ■ ^Hp(q,t) 



Pnew (q,t). (59) 



p(q,t) ' ' \ dt 

It can be verified Pnewi^t) — p(q.,t) is indeed a solution of above equation. Treating 

p(q, t) dt 

and the Feynman-Kac formula Ea. 1(57(1 may be applied. The analogous procedure is well studied on the transitions 
during adiabatic processes in interaction picture of quantum mechanics^^ and of statistical mechanics^. 
Now, let p be the instantaneous Boltzmann-Gibbs distribution of Ea. 1(58(1 : p = pg{<\; A(t)). We have 

SL = -0X^ . 

OA 

Ea 1159(1 can be solved by summing over all trajectories using the Feynman-Kac formula, Ea. f57p . At the same time, 
we know the instantaneous Boltzmann-Gibbs distribution of Ea. (|58|) is its solution. Hence equal those two solutions 
to the same equation, we have following equality 



Following Jarzynskisi we define the dynamical work 



<5(q-q(i))e Jo y ' 



(60) 

trajectory 



W,-f«M W*2W> (61) 
Jo 

The equality between the free energy difference AFg = Fg(t) —Fg(G)) and the dynamical work Wt is, after summation 
over all final points of the trajectories in Ea. (|6U|l . 



e 



-f3AF e 



(e-^)L . , (62) 

\ / I trajactory 



This elegant equality connects the steady state quantities AFg to the work done in a dynamical process. It was first 
discovered by Jarzynski^k It should be emphasized that there is no assumption of steady state state at time t for 
the system governed by Ea. 1)12(1 . In fact, it is known, for example, in case of the Landau-Zener transition that it 
is nol4£. This equality has been discussed and extended by various authors from various perspectives^l^2^2iSfli5iiS. 
The connection of this equality to the Fyenman-Kac formula was first explicitly pointed out in Ref4£. There have 
been experimental verifications of this equality^. 

The Jarzynski equality places the Boltzmann-Gibbs distribution hence the canonical ensemble in a central position. 
They are simply natural consequences from the Darwinian dynamics. However, if starting from the conservative 
Newtonian dynamics, the appropriate ensemble is the micro-canonical ensemble. Any distribution function which 
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is a function of the potential function or Hamiltonian would be the solution of the Liouville equation. From this 
point of view the Boltzmann-Gibbs distribution and the associated temperature appear arbitrary: It is just one 
among infinite possibilities. This concern has been raised in literature^ regarding to the generality of the equality of 
Eci. (|62[) . No satisfactory treatment of this concern within Newtonian dynamics has been given. Rather, it has been 
an "experimental attitude": If one does this and makes sure the procedure is correct one gets that, and it works. 
Instead, the Darwinian dynamics provides one a priori reason to justify the use of Boltzmann-Gibbs distribution in 
the derivation of the Jarzynski equality. 



C. Generalized Einstein relation 



In deriving the Boltzmann-Gibbs distribution from the Darwinian dynamics, a generalization of the Einstein rela- 
tion, Eq.©: 

[R(q) + T(q)] D(q) [R(q) - T(q)] = R(q) , 

has been used2&. This is another general and simple dynamical equality. In the presence of detailed balance condition, 
that is, T = 0, this relation reduces to RD = 1, which was discovered a century ago by Einstein 55 ^ and since known as 
the Einstein relation. Variants of the Einstein relation in different settings were obtained earlier and independently by 
Nernst- 56 , Townsend^, Sutherland^. Similar to the Jarzynski equality, the generalized Einstein relation is connected 
to the Boltzmann-Gibbs distribution. 

Experimentally all those quantities in Eq.© can be measured. Hence, this generalized Einstein relation should be 
subjected to experimental tests in the absence of detailed balance, that is, when T ^ 0. 

For simplicity, we consider a situation realizable with current technology: a charged nanoparticle or macromolecule, 
an electron or a proton, with charge denoted by e, in the presence a strong uniform magnetic field B and emersed in a 
viscous liquid with friction coefficient rj. We restrict our attention to two dimensional case (n — 2). The corresponding 
Darwinian dynamical equation of Eq. in this case is the Langevin equation with the Lorentz force for a " massless" 
charged particle^: 

7?q + -Bz x q= -V0(q) + N n £(t) (63) 
c 

The friction matrix is 

S = v( 1 Q ° 1 ) (64) 



The transverse matrix is 



/ -r>(\ ) (or.) 



c 



and the "temperature" is 9 = }zbTbGi the Boltzmann constant and the thermal equilibrium temperature. The 
corresponding Fokker-Planck equation following Eq. (|12|) is 

= V [£>0 V+[D + A]V0(q)]p(q, t) . (66) 

This is a precisely a diffusion equation with diffusion matrix D. Both D and A can be obtained via the generalized 
Einstein relation, Eq.©: 

D = V -^(l°,) (67) 



A = sE — ( 1 ) (68) 

In a typical classical situation, though all quantities can be measured experimentally, the friction coefficient is likely 
less sensitive to the magnetic field. Then the experimentally one may need to focus on the diffusion in the present 
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of magnetic field without any potential field. In this case the evolution of distribution is governed by the standard 
diffusion equation: 



dp(q,t) 
dt 



= 6d B v 2 p(q, t) , 



(69) 



with 



v 2 + m 



The solution to Ea. (|69|) with p(q, t = = Sq(t = 0) — q is standard (two dimension, n = 2): 



p(<l, t) 



2?r t 



exp 



2d B t 



Averaging over trajectories governed by Ea. lj6l?|) . (q(i) — q(i = 0)}| 



trajectory 



and 



<(q(t)-q(t = 0)) 2 ) 



trajectory 



t 



The readily experimental system may be that by injection of electrons into a semiconductor one measures their diffusion 
in the presence of a magnetic field. Every quantity in the generalized Einstein relation of Eq.© can be measured and 
controlled experimentally. Such experiments may has already been done (????). Another experimental system may 
be on ionized hydrogen or deuterium. For charged macromolecules and nano-particles, the friction coefficient may 
be too large to allow a measurable magnetic field effect accessible by current magnets. As a numerical example, for 
the zero magnetic field diffusion constant of c?B=ofcs7sG ~ 10 4 cm 2 /sec, which amounts to diffuse about 100cm in 1 
second, the friction coefficient is ?/ = l/rig^o ~4x 10~ 16 dyne/(cm/sec) at temperature Tbg = 300-ftT. Assuming one 
net electron charge, for magnetic field B — 1 Telsa , we have eB/c ~ 1.6 x 10 -16 dyne/ (cm/ sec), comparable to the 
friction coefficient. 



VI. PROSPECT 



In the present paper we have presented the statistical mechanics and thermodynamics as natural consequences of 
the Darwinian dynamics. Two types of recently found general dynamical equalities have been explored. Both can be 
directly tested experimentally. Everything appears in its right place except one: From the physics point of view it 
is the conservative dynamics from which we should start, not that of the Darwinian. This physics view has indeed 
tremendous of experimental supports. Remarkable progresses have been made along this line of reasoning during past 
150 years. It is still the subject of current intensive research focus 1 ^* 1 ^^. The physics effort may be condensed to 
one question. The natural consequence of the conservative dynamics is the micro-canonical ensemble, from which the 
canonical ensemble just appears to be one of its infinite possibilities. How and why does Nature choose the canonical 
ensemble and the Second Law? There is no consensus yet on the answer . 

The difficulty in reaching the Second Law from the conservative dynamics may give a boost to consider the Darwinian 
dynamics. There is, however, a genuine and compelling reason to to do so: the Darwinian dynamics is the most 
fundamental and successful dynamical theory in biological sciences. Furthermore, as having demonstrated above, 
from it the Second Law and other nonequilibrium properties follow naturally. Logically it provides a simple starting 
point. It must contain an element of truth. 

The conservative dynamics and the Darwinian dynamics appear to occupy the two opposite ends of the theoretical 
description of Nature. Both have been extremely successful. In many aspects they appear to be complementary 
to each other. Wether or not there is a hidden reason such that they are truly related to each other is not known 
presently. It waits to be discovered by further experimental and theoretical studies. The present deliberation may 
provide a certain utility for this endeavor. 
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